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Abstract 

As an generalization of deterministic, nonlinear conservative systems, a notion of 
canonical conservative dynamics with respect to a positive, differentiable stationary 
density p{x) is introduced: x = j{x) in which V • (p(x)j(x)) = 0. Such sys- 
tems have a conserved "free energy function" F[u] = f u(x,t)1n (u(x,t)/p(x))dx 
in the phase space with density flow u(x,t) satisfying ut = — V • (ju). Any gen- 
eral stochastic diffusion process without detailed balance, in terms of its Fokker- 
Planck equation, can then be decomposed into a reversible diffusion process with 
detailed balance and a canonical conserved system. This decomposition can be rig- 
orously established in a functional space with inner product defined as (</>, ift) = 
f p^ 1 (x)4>(x)ip(x)dx. Furthermore, a law for balancing F[u] can be obtained: The 
non-positive dF[u(x, t)]/dt = Qhk(t) — e p (t) where the "source" Qhk{t) > and the 
"sink" e p (t) > are known as energy pumping and entropy production, respectively. 
A reversible diffusion has Qhk = 0. For a linear (Ornstein-Uhlenbeck) diffusion 
process, our decomposition is equivalent to the previous approaches developed by R. 
Graham and P. Ao, as well as the theory of large deviations. 



1 Introduction 

With the recent development of stochastic thermodynamics in terms of mesoscopic entropy 
production [HI El 13, free energy dissipation 010, work equalities and fluctuation theorems 
J6j, and the mathematical theory of nonequilibrium steady state EHIED, there is a revitalied 
interest in stochastic nonlinear dynamics iTTOl . particularly those without detailed balance 
ifTTfl. also known as irreversible Markov processes. 
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For a general discrete state Markov process, either with discrete or continuous time, a 
decomposition theorem is known [|7] H2). In a nutshell, the transition probability matrix of 
a Markov process, with respect to its stationary distribution, can be decomposed in terms 
of a symmetric and an anti-symmetric parts. The latter part can be further decomposed into 
many pure rotations among the discrete states. The notion of cycle kinetics arises in this 
analysis fI51H51 . 

For continuous diffusion processes on W 1 without detailed balance, such a decompo- 
sition has never been fully established, even though computations have revealed both sta- 
tionary density and rotational flux as key determinants of a stationary process [fT5l . A so- 
phisticated analysis on a compact differentiable manifold also exists |f71[T6ll. In the physics 
literature, R. Graham and coworkes have proposed and studied extensively a decomposition 
of non-gradient vector field in terms of Fokker- Planck equations, via WKB method and a 
Hamilton- Jacobi equation |fT7l[T8l[T9ll . But the program was ultimately abandoned due to 
technical difficulties [20]. In recent years, P. Ao and coworkers have again proposed a re- 
lated decomposition from a rather different starting point [|2Tll22ll23ll24ll25l . However, the 
feasibility of this new approach has been rigorously demonstrated only for a linear system 
11211 which is nearly equivalent, apart from the normalizability of the invariant density, to 
analyzing irreversible Ornstein-Uhlenbeck processes [26]. Still, their emphasis on stable as 
well as unstable fixed points had suggested the possible applicability to nonlinear systems. 
A full analysis beyond heuristic for general nonlinear diffusion processes without detailed 
balance still is not available. See [23 1 and [ 271 for more, and recent discussions. 

The central piece of the Fokker-Planck equation of a diffusion process is a linear, par- 
tial differential operator C [1281 171. Assuming the existence of a unique stationary density 
p(x) > 0, i 6 I* and C(p) = 0, an inner product in a functional space 

(4>, ip) = / <fi(x)'i/j(x)p~ 1 (x)dx (1) 

can be introduced [|2~8l |7J. For diffusion process with detailed balance, this functional 
analysis approach is reduced to the Sturm-Liouville problem. In the present work, we 
follow this approach and introduce an operator decomposition in terms of a symmtric C s 
and an anti- symmetric C a : C = C s + C a . While the partial differential equation (PDE) 
(d/dt — C s ) (u) = representing a reversible diffusion process is a gradient- like system, 
as expected for a symmetric operator, the PDE (d/dt — C a )(u) = turns out to be a 
hyperbolic system. 
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We show that the anti-symmetric system is in fact a generalization of the conservative 
nonlinear dynamics one usually studies [29 ] where the p being uniform. If one calls the 
usual conservative dynamics x = g(x) with V • g(x) = a microcanonical system, then 
the dynamical system defined by C a with x = j(x) in which V • (p(x)j(x)) = could 
be called a canonical system. Indeed, for the density function u(x, t) in the phase space, a 
microcanonical dynamics has 

— ( — f u(x,t)\nu(x,t) dx\ =0, (2a) 
dt V Jk™ / 

as was known to Boltzmann, while a canonical dynamics has 

0. (2b) 



u(x,t) In I V-^lL. \ dx 



d 

— I u[x,t) In I - 

Eqs. (l2al) and (l2b~l) can be used as the definitions for microcanonical and canonical conser- 
vative dynamics, respectively. 

2 Fokker-Planck differential operator decomposition 

A general Fokker-Planck equation is characterized by a symmetric n x n diffusion matrix 
A(x) and a vector field, b(x), the drift. In the present work, we shall denote the linear 
differential operator in a functional space 

£(0) = V (A(x)V(f)(x)) - V (b(x)(j)(x)) , (3) 
£*((/>) = V(A(x)V(f)(x))+b(x)V(f)(x), (4) 

and adopt the inner production given in Eq. dl]), in which p{x) is the normalized stationary 
solution to the PDE C{p) = 0. We assume it is unique, positive and differentiable [1281171. 
Then we have 



(V>, £(</>)) = / P^{x)dxV (A{x)V(f){x)) - V (b(x)4>(x)) 

{V [A(x)V (p~V(a:))] + b(x)V (p~ l ^{x)) } <f>(x)dx 



( P c (p-V),0>- 
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We now introduce symmetric and anti-symmetric operators 

1 



cm = l -{c{<t>)- P c (p-V)}- 



Then, 



(5) 
(6) 

(7) 
(8) 



(V,£ a (0)> = -(£aW,< 

and £ has been decomposed into (C s + C a ). 

3 Symmetric reversible diffusion 

The partial differential operator 

C s (it) = V (a(i)Vm(x) - V In p(x)) (9) 

is a Fokker-Planck type with diffusion tensor A(x) and drift A(x)V In p(x). One can im- 
mediately see that p(x) is its stationary density. The diffusion process associated with C s 
has been extensively studied in the past and is well understood. 
The corresponding partial differential equation (PDE) 

du(x, t) 



dt 



is formally a gradient system 



du 
~dt 



C s (u(x,t)) 
5 (C a (u),u) 



(10) 



(11) 



Su 2 

See [281 for many important properties associated with reversible diffusion processes. 

Potential function, entropy production and stochastic free energy. The "potential 
function" in Eq. (fTT) 



(C s (u),u) 



u(x, t) 
p{x) 



A{x) 



Vln 



u(x, t) 
p{x) 



u(x,t)dx. (12) 



The gradient system in (TTTT) is confined on an affine subspace with J Rn u(x)dx = (p(x),u(x)) 
= 1. The PDE (flOl) has also been shown as a gradient flow generated by a potential func- 
tion F[u] on an appropriate Riemann manifold with Wasserstein metric [[30l[3Ti . The F[u] 
is knonwn as the "stochastic free energy" for the Markov system 113211231 141151: 

u(x, t) 



F[u(x,t)] 



u(x, t) In 



p(x) 



dx = (pu, In (p u) ). 



(13) 



Then for u{x, t) following the self-adjoint PDE CGI 05131151. 

C a (u),phL(p- x u)) = -e p . (14) 



The e p > is known as the entropy production rate for the reversible diffusion process 
[1281 171. A stationary reversible diffusion, therefore, has e p = 0. 

Stochastic differential equation for trajectories. One can also write a stochastic differ- 
ential equation for the diffusion process described by Eq. (TTQb . If we follow Ito's notion of 
stochastic integration, we have 

dxiit) = p-\x) {^T Ai ^P^ dt + ^ V ij(x) dB A t )i (!5) 

in which matrix A(x) = ^T(x)T T (x), and Bi{t) are standard Brownian motions. On the 
other hand, if one follows Stratonovich's integration, one has 

(d In (x) 1 d i 

Ajix) ^ + - T ik {x)—T jk {x) J dt + ruffldBjit), (16) 
3 fe 3 J j 

and if one takes the "divergence form" for the integration, as strongly advocated by P. Ao 
El El, then 

dxi(t) = (^(^)^- ln P( f )) dt + J2 Ti ^ dB ^- (17) 

3 J j 

4 Canonical conservative dynamics 

On the other hand, the anti- symmetric partial differential operator 

C a {u) = v((A(x)V\np(x) -b(x))u(x)) (18) 

= (A(x)Vp(x) -b(x)p(x)) ■ V(p" 1 (a;)u(a;)). (19) 

The corresponding PDE 

^^ = £.(«(M)) (20) 

is not diffusive but rather it is hyperbolic. It is easy to verify that p(x) is again a stationary 
density for Eq. (1201 . Eq. (fT9l actually is the Liouville equation in the phase space for the 
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nonlinear ordinary differential equation (ODE) 

dx 

— = b(x) - A(x)Vlnp(x) = j(x). (21) 
The j(x) in Eq. (12TI) satisfies 

V • (p(x)j(x)) = 0. (22) 

That is, 

V ■ j(x) + j(x) ■ Vlnp(x) = 0. (23) 



We shall call Eq. (|2lJ) "canonical conservative system" with respect to stationary den- 
sity p(x). Since p(x) is an invariant density to the dynamics in Eq. (|20l ), one can again 
consider the free energy functional [|32j |25] SI |5) 

F[u(x,t)]= [ u{x,t)ln(^^)dx. (24) 

For the hyperbolic system, this is a generalization of Boltzmann's //-function in which the 
stationary distribution p(x) = constant due to "equal probability a priori". Then one has 
01 El 

dF{t) _ f du(x,t) (u(x,t)\ ^ 



dt J Rn dt \ p(x 

]{x)u{x,t) 



dx 

u{x,t) p(x) 
(V • j(x) + j(x) ■ V In p(x))u(x, t) dx 
= 0. (25) 

In the derivation we have used Eqs. (|20l) and (1231) as well as assumed that u(x,t) — > 
sufficiently fast when ||x|| — > oo. 

The result in Eq. (1231 ) is reminiscent of a Boltzmann's result before he introduced 
his Stosszahlansatz- His //-function, — J f(x, t) In f(x, t) dx, actually is invariant with re- 
spect to time if f(x, t) follows strictly the phase space Liouville equation for a Hamiltonian 
dynamics. One also notes that the L 2 norm of u(x, t) is conserved in a canonical conser- 
vative dynamics: ^\\u(x,t)\\ 2 = (£ a (u),u) = —(u,C a {u)) = 0. Actually, any functional 
J* Rn uG(u/ p)dx is a conserved quantity for Eq. (|20T ). 

Fixed points in canonical conservative system. Eq. (|23l indicates that V • j(x) =0 at 
the fixed point of vector field j(x) = 0. Without loss of generality, let x* = be a fixed 
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point: j(x*) = 0. Then in the neighbourhood of x* = one has 

j(x) = Bx + -x T Gx + ■ ■ ■ , p(x) = p(0) + q ■ x + ■ ■ ■ , (26) 

in which the Jacobian matrix B has elements B ik = dje(0) /dxk, tensor elements Ggkh — 
d 2 je(0)/dxkdxh, and gradient q has elements q^ = dp(0)/dxk. Then the Eq. (1231) becomes 

p(0)Tr[£] + qBx + Tr[B]q- x + ^Y, + G ^ x ^ + ONI') = °' ^ 27 ^ 

Vx. Since p(0) ^ this yields Tr[S] = 0. Furthermore, 

y d\np(0)dM0) | d 2 Je (0) _ Q 
^ dxi dx k dxidx k 

Hence, the fixed point of a canonical conservative system can not be a node or focus. It has 
to be either a saddle or a center, just as in a Hamiltonian system [|29l . 

Stationary points of p(x) in canonical conservative system. Eq. (|23l) also indicates 
that V -j(x) =0 at the stationary position of p where Vp(x s ) = 0. A similar local analysis 
can be carried out near x s , and one has 

£*M?^ + f=^ = 0. (29) 

Planar canonical conservative system. A planar canonical conservative system has 
the general form x = p~ 1 (x,y)dH(x,y)/dy, y = —p~ l (x ) y)dH(x ) y) / dx. The phase 
portrait for this system is identical to the Hamiltonian system with p = 1. Indeed, H(x, y) 
is a conserved quantity in the dynamics: dH(x(t),y(t))/dt = 0. 

Mapping to microcanonical system via time change. More generally, let p(x)j(x) = 
f(x). Let x(t) be a solution to the microcanonical conservative system x = f(x). Then the 
solution to the canonical conservative system with same initial value is x(t) = x (t(t)) in 
which 

i(t) =t + p' 1 (x(s)) ds. 

Jto 

5 General diffusion processes without detailed balance 

We now bring the results from the above two sections to bear on the general diffusion 
processes. 
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Decomposing free energy dissipation In terms of j(x), the "thermodynamic force" 
in a general diffusion generated by C EBl 

b{x) - A{x)Vlau{x) = j(x) - |A(x)Vln (j^jj }> ( 3 °) 

in which the j(x) characterizes the deviation of b(x) from a gradient force; it does not 
involve u(x). And since the p(x) is uniquely determined by the diffusion matrix and drift, 
j(x) is a non-dynamic term strictly determined by the A(x) and b(x). The term in {• • • } 
characterizes non-stationarity of the u(x). Then we have, 

£(u),p\n (p-'u) ) = U s (u),p\n (p^u) ) + (c a (u),p\n (p~ l u) ). (31) 



The last term is zero for the canonical conservative system, e.g., Eq. (|25T) . Therefore, the ^ 
for a general diffusion process with C is entirely due to its symmetric part of the diffusion, 
C s . The canonical conservative dynamics generated by C a has no contribution toward the 
free energy dissipation of C 

Non-negative source for free energy F[u]. Another important quantity from physics, 
the house keeping heat first proposed by Oono and Paniconi [|35] @], also called adiabatic 
entropy production [21, is 

Q hk = f (b- AV\Yi P )A- 1 {x){bu- AVu)dx= (pj,A- l (bu- AVu)) (32) 

for a general diffusion process. It is a type of projection of the thermodynamic driving 
force (b(x) — A(x)V lau(x)) onto the j(x). It is zero for a reversible diffusion process 
with j(x) = 0. Noting the Eq. (|30l) . we have 



Q hk = (pj, A-'ujj - (pj, P V(p- l u) J = (pj, uA- x j) > 0. (33) 
Then the free energy dissipation for a general diffusion 

= Qhk(t) - e p {t), or e p {t) = Q kh {t) - (34) 

All three terms e p , Qhk, — ^j? are non-negative. A symmetric diffusion has Qhkif) = 
Vi (Eq. dU); a canonical conservative dynamics has = Vt (Eq. [25]). A general 
diffusion process without detailed balance has e p (t) which is consist of non-negative — ^ 
and Q hk - More logically, we believe Eq. (|34l ) should be interpreted as a balance equation 
for free energy F[u] with a source Q hk and a sink e p . The fact that both Q h k and e p are 
non-negative indicates that we have found the authentic source and sink terms for the free 
energy F[u]. 
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6 Ornstein-Uhlenbeck process: the linear case 



We now consider the relationship between the above result and P. Ao's decomposition 
ll22l . We shall explicitely work out the details for the Ornstein-Uhlenbeck (OU) Gaussian 
process [|26l |2T) . We show that in the linear case, the two theories are equivalent. The 
present approach is also equivalent to that of R. Graham's ll20l under the assumption of 
large deviation principle. 

We consider linear vector field b(x) = Bx and constant diffusion matrix A. The n- 
dimensional Fokker-Planck equation is 

^^ = V(AVu(x,t)-Bxu(x,t)). (35) 

It is easy to verify that the stationary solution has a Gaussian form ll26l 

1 f 1 r -i 1 

p(x) = - — r — ^— — — exp < — x c x > , (36) 

in which the covariant matrix H satisfies the Lyapunov matrix equation 

BE + ~B T + 2A = 0. (37) 

Accordingly, we have 

Bx = AV In p(x) + j(x) = -AE^x + j(x), j(x) = Jx, (38) 

where matrix J = B + AE^ 1 . We now show that matrix J can be written as — RE^ 1 in 
which R is an anti-symmetric matrix. This is because of Eq. (l37l . 

-R T = (BE + A) T = EB T + A = -(BE + A) = R. 



Therefore, B = — (A + R)E . So the linear stochastic differential equation dx(t) 

1 



Bxdt + TdB(t), with |rr T = A, can be re-written as 



Mdx(t) = -V \^x T E- 1 xj dt + UdB(t) 

= V{lnp{x))dt + UdB(t), (39) 

where II = (A + R)"^ and M = (A + R)' 1 . They are related via 

m + m t = nn T , (40) 
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because 



IT 1 [(A + r)- 1 + (A + Ry T ] rn T = r^ 1 [(A -R) + (A + r)} t- t 

= 2r~ 1 Ar~ T = i. 

Eq. (l39l) , together with (l40l . is Ao's form of stochastic differtial equation [22] . For the 
linear system, one also has an additional property: the gradient field —E~ l x and canonical 
conservative dynamics Jx are actually orthogonal: 

(E~ l x) T ■ (Jx) = -x T E- x BET x x = - (H _1 z) T R (E^x) = 0. (41) 

This orthogonality was noted in both [20j and lETl . See [|2~6l and ETI for more discussions 
on irreversible OU processes. 

7 Discussion 

The above result provides some insights into the structural stability of non-gradient vector 
field b(x). Zeeman ll36ll has advocated the approach to structural stability based on e-noise 
perturbed dynamical systems. With respect to non-gradient field with a focus, he clearly 
noted one key difficulty in the Morse-Smale theory which requires a mapping from a focus 
to a node. While such a homeomorphism exists, "It is impossible, however, to make [such 
a map] smooth. ... Therefore in the attempt to capture density in two dimensions we have 
to abandon smoothness in the very definition of structural stability, and this, alas, is the 
beginning of the rot." Il36l 

For simplicity, let A(x) = e, then b(x) = j e (x) + eVlnp e (x) in which p e (x) is the 
stationary density for the randomly perturbed dynamical system dx(t) = b(x)dt + edB(t), 
and j e (x) is a canonical conservative system. In the limit of e — > 0, whether a limit exists 
for — e In p e (x) is precisely the theory of large deviations fl37l l38l . If a differentiable limit 
U(x) exists, then one obtains a decomposition b(x) = jo(x) — VU(x). Moreover, since 
V-(p e (x)j e (x)) = OVe, one also has — ej e (x)- V lnp e (x) = eV-j e (x). Thus j (x)-VU(x) = 
if the convergence is uniform, i.e., the decomposition is orthogonal. This is indeed R. 
Graham's theory [|20l|38). On the other hand, if p t (x) has a nonzero limiting density po(^) 
on an attractor, then U(x) = on the entire attractor. This has been explicitly shown 
for systems with limit cycles and invariant tori where the asymptotic stationary density 
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p e (x) ~ po(x)e~ u ( x " € [fTTI . However, if the limit U(x) is non-differentiable or worse, 
some weaker forms might still exist [39 1 . This is the technical challenges encountered by 
R. Graham and his coworkers Il20l ; further investigations are required. The present work 
could provide a different approach to the challenge. 



teresting contradistinction between two views on time irreversibility. It is now known that 
entropy production e p can be defined as the relative entropy between the probabilities of 
a trajectory cu t and its time reversal r(co t ), under the probability measure generated by C 
|[3l|40]|. For a stationary diffusion, the probability for the r(u t ) with the measure generated 
by C = C s + C a is in fact the same as the tu t under the measure generated by Cr = C s — C a 
[|40l . Now, if one introduces a different entropy production e* as 



in which the P _ * is defined as the probability of time-reversed trajectory r(co t ) under the 
measure generated by L~ . Then P~* = P and e* = for any stationary diffusion, as well as 
the canonical conservative dynamics. With such a choice for the definition of time reversal, 
there will be no nonequilibrium steady state; only equiliblium in which e* = Q* hk = 0. 
Indeed, a Hamiltonian system is considered to be time reversible in classical dynamics 
precisely due to the second type of time reversal pT|. 

Finally, we note that the decomposition of a general diffusion process into an C a and an 
C s parts unifies nicely the ealier mathematical theories of dynamics formulated respectively 
by Newton and Fourier [|42ll43l . 

I thank Ping Ao, Hao Ge, Da-Quan Jiang, Yao Li and Jin Wang for many helpful 
discussions. I particularly acknowledge Dr. P. Ao for his inspiration, encouragement, and 
comradeship. The present work grew out of a desire to reconcile the decomposition in his 
Darwinian dynamics ll25l and the nonequilibrium steady-state circulation decomposition 
theorems in [|7l . 

References 

[1] Esposito, M. (2012) Stochastic thermodynamics under coarse graining. Phys. Rev. E 
85,041125. 



Canonical conservative system with 



dF(t) 



Qhk{t) — e P (t) = also leads to an in 



dt 




(42) 



11 



[2] Seifert, U. (2008) Stochastic thermodynamics: Principles and perspectives. Eur. Phys. 
J. 5 64, 423-431. 



[3] Qian, M.-R, Qian M. and Gong, G.-L. (1991) The reversibility and the entropy pro- 
duction of Markov processes. Contemp. Math. 118, 255-261. 

[4] Ge, H. and Qian, H. (2010) The physical origins of entropy production, free energy 
dissipation and their mathematical representations. Phys. Rev. E 81, 051 133. 

[5] Esposito, M. and van den Broeck, C. (2010) Three detailed fluctuation theorems. 
Phys. Rev. Lett. 104, 090601. 

[6] Jarzynski, C. (201 1) Equalities and inequalities: Irreversibility and the second law of 
thermodynamics at the nanoscale. Ann. Rev. Cond. Matt. Phys. 2, 329-351. 

[7] Jiang, D.-Q., Qian, M. and Qian, M.-P. (2004) Mathmatical Theory ofNonequilibrium 
Steady States, LNM 1833, Springer, New York. 

[8] Zhang, X.-J., Qian, H. and Qian, M. (2012) Stochastic theory of nonequilibrium 
steady states and its applications (Part I). Phys. Rep. 510, 1-86. 

[9] Ge, H., Qian, M. and Qian, H. (2012) Stochastic theory of nonequilibrium steady 
states (Part II): Applications in chemical biophysics. Phys. Rep. 510, 87-1 18. 

[10] Qian, H. (2011) Nonlinear stochastic dynamics of mesoscopic homogeneous bio- 
chemical reactions systems - An analytical theory (invited article). Nonlinearity, 24, 
R19-R49. 

[11] Ge, H. and Qian, H. (2012) Landscapes of non-gradient dynamics without detailed 
balance: stable limit cycles and multiple attractors. Chaos, in the press. 

[12] Qian, M.-P. and Qian, M. (1982) Circulation for recurrent Markov chains. Z Wahrsch. 
Verw. Gebiete., 59, 203-210. 

[13] Hill, T.L. (2004) Free Energy Transduction and Biochemical Cycle Kinetics, Dover, 
New York. 

[14] Kalpazidou, S.L. (2006) Cycle Representations of Markov Processes, 2nd ed., 
Springer, New York. 



12 



[15] Wang, J., Xu, L. and Wang, E. (2008) Potential landscape and flux framework of 
nonequilibrium networks: Robustness, dissipation, and coherence of biochemical os- 
cillations. Proc. Natl. Acad. Sci. U.S.A. 105,12271-12276. 

[16] Qian, M. and Wang, Z.-D. (1999) The entropy production of diffusion processes on 
manifolds and its circulation decompositions. Comm. Math. Phys. 206, 429-445. 

[17] Graham, R. and Haken, H. (1971) Generalized thermodynamic potential for Markoff 
systems in detailed balance and far from thermal equilibrium. Z. Physik, 243, 289- 
302. 

[18] Graham, R. (1973) Statistical theory of instabilities in stationary nonequilibrium sys- 
tems with applications to lasers and nonlinear optics. In Quantum Statistics in Optics 
and Solid-state Physics, Springer Tracts in Modern Physics, Vol. 66, pp. 1-97. 

[19] Graham, R. (1989) Macroscopic potentials, bifurcations and noise in dissipative sys- 
tems. In Noise in Nonlinear Dynamical Systems, Moss F. and McClintock, P.V.E. eds., 
Cambridge Univ. Press, pp. 225-278. 

[20] Graham, R. and Tel, T. (1984) Existence of a potential for dissipative dynamical 
systems. Phys. Rev. Lett. 52, 9-12. 

[21] Kwon, C., Ao, P. and Thouless, D.J. (2003) Structure of stochastic dynamics near 
fixed points. Proc. Natl. Acad. Sci. USA 100, 3054-3058. 

[22] Ao, P. (2004) Potential in stochastic differential equations: Novel construction. J. 
Phys. A. 37, L25-L30 

[23] Yin, L. and Ao, P. (2006) Existence and construction of dynamical potential in 
nonequilibrium processes without detailed balance. J. Phys. A: Math. Gen. 39, 8593- 
8601. 

[24] Ao, P., Kwon, C. and Qian, H. (2007) On the existence of potential landscape in the 
evolution of complex systems. Complexity, 12, 19-27. 

[25] Ao, P. (2008) Emerging of stochastic dynamical equalities and steady state thermo- 
dynamics from Darwinian dynamics. Commun. Theor. Phys. 49, 1073-1090. 



13 



[26] Qian, H. (2001) Mathematical formalism for isothermal linear irreversibility. Proc. 
Roy. Soc. A. 457, 1645-1655. 

[27] Shi, J., Chen, T., Yuan, R., Yuan, B. and Ao, P. (2011) Relation of biologi- 
cally motivated new interpretation of stochastic differential equations to Ito process. 
[http://128.84. 158. 1 19/abs/l 1 1 1.2987) 

[28] Qian, H., Qian, M. and Tang, X. (2002) Thermodynamics of the general diffusion 
process: Time-reversibility and entropy production. J. Stat. Phys. 107, 1129-1141. 

[29] Perko, L. (2006) Differential Equations and Dynamical Systems, 3rd ed., Springer, 
New York. 

[30] Jordan, R., Kinderlehrer, D. and Otto, F. (1998) The variational formulation of the 
Fokker-Planck equation. SIAM J. Math. Anal. 29, 1-17. 

[31] Chow, S.-N., Huang, W., Li, Y. and Zhou, H. (2012) Fokker-Planck equations for a 
free energy functional or Markov process on a graph. Arch. Rati. Mech. Anal. 203, 
969-1008. 

[32] Mackey, M.C. (1989) The dynamic origin of increasing entropy. Rev. Mod. Phys. 61, 
981-1016. 

[33] Spohn, H. (1978) Entropy production for quantum dynamical semigroups. J. Math. 
Phys. 19, 1227-1230. 

[34] Voigt, J. (1981) Stochastic operators, information, and entropy. Comm. Math. Phys. 
81,31-38. 

[35] Oono, Y. and Paniconi, M. (1998) Steady state thermodynamics. Prog. Theor. Phys. 
Suppl. 130, 29-44. 

[36] Zeeman, E.C. (1988) Stability of dynamical systems. Nonlinearity 1, 115-155. 

[37] Freidlin, M.I. and Wentzell, A.D. (1989) Random Perturbations of Dynamical Sys- 
tems, Spinger, New York. 

[38] Ge, H. and Qian, H. (2012) Analytical mechanics in stochastic dynamics: most prob- 
able path, large-deviation rate function and Hamilton- Jacobi equation. Preprint. 



14 



[39] Cowieson, W. and Young, L.-S. (2005) SRB measures as zero-noise limits. Ergod. 
Th. Dynam. Sys. 25, 1091-1113. 

[40] Ge, H. and Jiang, D.-Q. (2007) The transient fluctuation theorem of sample entropy 
production for general stochastic processes. J. Phys. A. Math. Theor. 40, F713-F723. 

[41] Kim, K.H. and Qian, H. (2004) Entropy production of Brownian macromolecules 
with inertia. Phys. Rev. Lett. 93, 120602. 

[42] Newton, I. (1999) The Principia: Mathematical Principles of Natural Philosophy, 
Univ. Calif. Press, CA. 

[43] Fourier, J.B.J. (2009) The Analytical Theory of Heat, Freeman, A. transla. Cambridge 
Univ. Press, London. 



15 



